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Preface:  This  technical  report  is  a short  manuscript  prepared  for 

the  proceedings  of  the  41st  Session  of  the  International  Statistical 
Institute  meeting  in  New  Delhi,  December,  1977  and  to  be  presented 
at  that  meeting.  Results  summarized  have  hewe  been  developed  in 
detail  in  ONR  Technical  Reports,  No.'s  99,  100  and  102  submitted 
earlier. 
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S(»IE  OPTIMAL  DESIGN  RESULTS  IN  PAIRED  COMPARISONS 


Ralph  A.  Bradley  and  Abdalla  T.  El-Helbawy 

Florida  State  University,  Tallahassee,  U.S.A. 
and  University  of  Cairo,  Cairo,  A.R.E. 


INTRODUCTION 

The  authors,  Bradley  and  El-Helbawy  (1976),  El-Helba«ry 
and  Bradley  (1977a, b)',  have  developed *the  methodology  for 
consideration  of  specified  treatment  contrasts  in  paired 
comparisons.  The  procedures  developed  give  much  new  flexi- 
bility to  the  use  of  paired  comparisons  and,  in  particular, 
to  the  use  of  factorial  treatment  cori>lnatlons  in  such 
experiments.  

The  probability  model  developed  by  Bradley  and  Terry 
(1952),  originally  proposed  by  Zermelo  (1929),  is  used.  Many 
additional  references  are  given  by  Davidson  and  Farquhar 
(1976)  in  their  bibliography  and  Bradley  (1976)  reviews 
various  approaches  to  the  model  and  its  extensions. 

In  this  short  presentation,  we  summarize  important  results 
on  treatment  contrasts  and  indicate  how  they  may  be  used  to 
consider  optimal  design  questions.  Some  simple  optimal 
design  results  are  given. 

SUMMARY  OF  METHODOLOGY 

Suppose  that  the  paired  comparisons  experiment  has  t 
treatments,  Tj^,...,T^,  with  n^j  comparisons  of  T^^  and  T^, 


“ 0,  i,  j • A parameter  is 

associated  with  T^,  > 0,  such  that  the  probability  of 

selection  of  when  compared  with  is 

pr(T^  > Tj)  * ir^/(TT^  + n^),  1 * j.  (1) 

The  convenient  scale-determining  constraint  is 


I Y.  - 0,  Y - log  TT  i - l,.,.,t, 
1-1  ^ ^ 


(2) 


different  from  that  used  by  Bradley  and  Terry.  On  the  assumption 
of  independence  of  selection  judgments,  the  likelihood  function  is 


is 


where  a 


L(ir)  - Ilir  / n (n  + ir  ) 
i ^ i<J  ^ J 


Ij 


(3) 


. is  the  total  number  of  selections  of  T . , ^ a , - N - J n . , . 

^ i ^ KJ 


ir  is  the  column  vector  with  typical  element  and  other  vectors 
below  are  defined  similarly. 

Treatment  contrasts  are  specified  as  linear,  orthonormal 
contrasts  on  the  y^.  The  typical  estimation  problem  is  to 
maximize  L subject  to  (2)  and 

“in  — ”“in 


where  0 is  a column  vector  of  zeros  and  B consists  of  m,  zero- 
-m  — m 

sum,  orthonormal  rows.  The  resulting  likelihood  equations  are 

I[aj  ~ I "jitPj/CPj  + Pk^J^lj  * 

j ^ 

I Yj(l)  - 0,  and  B^y(p)  • 0^, 

where  D is  the  (1, j)-element  of  I - B'B  . T , t|ie  t-square 
ij  “X  ni"n 

identity  matrix,  £ is  the  estimator  of  ir,  and  jc.(£)  of  xCe)  • 

El-Uelbawy  and  Bradley  (1977b)  show  that  »^[j;^(£)  - 

singular,  t-varlate  normal  limiting  distribution  function  in 

(t-ffl-1)  dimensions  with  zero  mean  vector  and  dispersion  matrix 

given  in  the  references.  El-Helbawy  and  Bradley  (1977a) 

examine  the  solution  of  (5)  and  convergence  properties  of  a 

suggested  iterative  scheme. 
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The  typical  testing  situation  assumes  (4)  and  specifies 
• 0^  against  the  alternative,  B^(ir)  * 0^  and 
uses  the  likelihood  ratio  statistic,  ).  It  Is  shown 

In  the  (1977b)  paper  that  -21og  chi-square 

limiting  distribution  with  n degrees  of  freedom,  central  under 
Hq  and  non-central  under  with  non-centrality  parameter, 

- A’  6 , (6) 

where  Is  a dispersion  matrix  dependent  on  given  In  the 
references  and  6.  « lim  6^,  Bv(ir^)  ■ and  {ir^}  is  a 

i N—  i 

sequence  of  local  alternatives  to  satisfying  (2)  and  (4) . 

Bradley  and  El-Helbawy  (1976,  1977b)  show  how  the  contrasts 

described  by  B and  B may  be  related  to  factorial  effects  when 
— m — n 

the  treatments  are  factorial  treatment  combinations  and.  Indeed, 
give  a reparamet''^''  tlon  of  the  problem  for  factorials. 

SOME  OPTDIAL  DESIGN  RESULTS 

The  results  summarized  above  for  the  first  time  provide 
means  of  considering  asymptotically  optimal  design  of  paired 
comparisons  experiments.  We  limit  consideration  to  two  examples 

3 

with  t ■ 8 and  a 2 -factorial.  T.  Is  associated  with  T , 

1 o 

o • (aj^,a2,aj),  ■ 0,1,  s ■ 1,2,3,  designating  the  level 

of  Factor  s In  the  treatment  combination. 

Consider  a test  of  no  Interaction  between  Factors  1 and  2; 

B In  (4)  does  not  exist  and  B describes  the  usual  analysis 
~m  — n 

of  variance  contrast  for  the  specified  treatment  contrast,  now 

in  terms  of  the  y . The  objective  Is  to  maximize  asymptotic 
* 2 

power,  that  Is,  to  maximize  X In  (6)  for  the  desired  test. 

Aa  In  (6)  depends  on  lu  and  1.,  ■ lim  n ./N,  1 « J.  The 

maximization  Is  with  respect  to  the  and  Is  taken  to 

be  Ig,  a column  vector  of  unities,  consistent  with  and  the 
concept  that  any  other  effects  present  are  of  the  same  order 
of  magnitude  relative  to  N as  the  contrast  under  test.  The 
experiment  Is  assumed  to  be  as  balanced  as  possible  but  to 


perndc  optimality  consideration ; we  take  ■ a or  b respectively 

as  T.  and  T.  represent  factorial  treatment  combinations  with 
i J oj+a, 

factor  levels  and  02  such  that  (-1)  does  or  does  not 

have  the  same  sign  for  the  two  treatments,  12a  -f  16b  > 1. 

2 

Maximization  of  X with  respect  to  a and  b,  12a  4-  16b  > 1,  yields 
a * 0,  b ••  1/16;  no  observations  are  taken  on  comparisons  that 
yield  no  Information  on  the  two-factor  Interaction  under  test. 

The  same  result  occurs,  for  example,  for  the  same  test  with  ^ 
chosen  to  assume  that  the  three-factor  and  other  two-factor  Inter- 
actions are  null. 

Suppose  that  all  factorial  effects  are  assumed  null  except 
the  three  Interactions  Involving  Factor  1.  Then  B has  four 

“TD 

rows.  We  take  ii  ■ ig,  a central  value  satisfying  (2)  and  (4) 

and  make  the  simplifying  assumption  of  as  much  balance  In  the 

experiment  as  possible  but  permitting  optimality  considerations . 

We  are  concerned  with  the  dispersion  matrix  ^ and  show  that 

one  should  take  all  X^^  - 0 except  for  those  treatment  comparisons 

yielding  Information  on  all  of  the  ^1^3“  ^1^2^3~ 

Interactions  for  A-,  D-  and  E-  optimality  minimizing  respectively 

^ > 1^  I file  largest  variance  of  I . 
r — m — m — m 

Some  other  exanq>les  are  given  by  El-Helbawy  and  Bradley 
(1977b) . While  the  results  noted  are  consistent  with  Intuition, 
formal  demonstration  Is  given  for  the  first  time  and  the  way 
Is  open  for  more  general  consideration  of  optimal  design  In 
paired  comparisons. 

SUMMARY 

The  authors  have  shown  (Blometrlka.  1976)  how  to  consider 
specified  treatment  contrasts  In  paired  comparisons  and  given 
applications  to  factorials.  In  a subsequent  paper,  pending 
publication,  they  consider  asymptotic  theory  and  applications  to 
optimal  design  when  the  treatments  are  factorial  treatment 
combinations.  This  paper  Is  a summary  of  some  of  the  main  results. 


SOMMAIRE 


Les  auteurs  out  d^montr^  (Blometrlka.  1976)  connent  A 
conslderer  des  contrastes  specif I4s  entre  traltements  en 
comparaisons  par  palres  et  donn4  des  applications  pour  traltements 
factorlels.  Dans  des  8ubs€quente8  recherches,  ne  pas  encore 
publides,  11s  ont  consld4r4  la  thdorie  asymptotlque  et  les 
applications  A desseln  optimal  quand  les  traltements  sont  des 
comblnalsons  factorlels.  Ce  papier  est  un  sonmaire  des  r4sultats 
prlnclpaux . 
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